Measuring Linguistic Growth in Sentence-Level Writing Curriculum-Based Measures: Exploring Complementary Scoring Methods.

PURPOSE: Picture-word writing curriculum-based measures (PW CBM-Ws) are technically sound, formative measures of descriptive, sentence-level writing but cannot estimate underlying linguistic skills. The purpose of this exploratory alternative scoring investigation was to apply metrics from language sample analysis (LSA) to PW CBM-Ws as a complementary measure of underlying language skills in beginning writers' sentence-level writing. METHOD: LSA metrics were applied to 104 typically developing first through third graders' PW CBM-W samples across fall and spring semesters. Factorial analyses of variance with post hoc Bonferroni pairwise comparisons were applied after obtaining alternate-form reliability and criterion-related validity estimates. RESULTS: Analyses revealed reliable discrimination between grades and significant growth between fall and spring semesters for three LSA metrics: mean length of T-unit in words, mean length of T-unit in morphemes, and number of different words. While mean length of T-unit in words and morphemes demonstrated evidence of discrimination and growth in first grade only, number of different words showed evidence of reliable discrimination and growth in first and third grades. CONCLUSIONS: Mean length of T-unit in words, mean length of T-unit in morphemes, and number of different words showed evidence of adequate criterion-related validity, discrimination among grades, and sensitivity to growth when calculated using PW CBM-W samples to gauge underlying linguistic skills in first- and third-grade students. Implications and future directions for research are discussed. SUPPLEMENTAL MATERIAL: https://doi.org/10.23641/asha.25050290.

Efficacy of a Technology-Based Early Language Comprehension Intervention: A Randomized Control Trial.

We examined the efficacy of a Technology-Based Early Language Comprehension Intervention (TeLCI) designed to teach inferencing in a non-reading context. First- and second graders identified as at risk of comprehension difficulties were assigned randomly to a business-as-usual control group or to use TeLCI over an 8-week period. TeLCI comprised three learning modules per week that involved (a) learning new vocabulary, (b) watching fiction or nonfiction videos, and (c) answering inferential questions. Students also engaged in small-group read-alouds with their teachers once per week. Students who experienced TeLCI improved their inferencing and benefited from scaffolding and feedback provided during the intervention. Students' pre- to posttest inferencing gains were comparable with those of control students. Female students and those receiving special education services appeared less likely to benefit from TeLCI, whereas multilingual students were more likely to respond. Further work is needed to determine the optimal conditions under which TeLCI will benefit young children.

Teacher Predictors of Student Progress in Data-Based Writing Instruction: Knowledge, Skills, Beliefs, and Instructional Fidelity.

Teacher-level factors are theoretically linked to student outcomes in data-based instruction (DBI; Lembke et al., 2018). Professional development and ongoing support can increase teachers' knowledge, skills, and beliefs related to DBI, as well as their instructional fidelity (McMaster et al., 2020). However, less is known about how each of these teacher-level factors influences student progress during an intervention. The purpose of this study was to examine the association between several important teacher-level factors-teachers' writing instruction fidelity, knowledge and skills related to DBI, explicit writing orientation, and writing instruction self-efficacy-and students' writing growth. Participants were 49 U.S. elementary teachers and their 118 students struggling with early writing skills. Using hierarchical linear modeling, we found a significant positive relation between DBI knowledge and skills and student writing growth, but no relation was found between writing instruction fidelity, writing orientation, or self-efficacy and student writing growth. Implications for writing instruction fidelity measurement in DBI and professional development related to teachers' DBI knowledge and skills are discussed.

Systematic Review of Curriculum-Based Measurement with Students Who Are Deaf.

This review systematically identified and compared the technical adequacy (reliability and validity evidence) of reading curriculum-based measurement (CBM) tasks administered to students who are deaf and hard of hearing (DHH). This review included all available literature written in English. The nine studies identified used four CBM tasks: signed reading fluency, silent reading fluency, cloze (write in missing words given blank lines within a passage), and maze (circle the target word given multiple choice options within a passage). Data obtained from these measures were generally found to be internally consistent and stable with validity evidence varying across measures. Emerging evidence supports the utility of CBM for students who are DHH. Further empirical evidence is needed to continue to explore technical properties, identify if student scores are sensitive to growth over short periods of time, and examine whether CBM data can be used to inform instructional decision-making to improve student outcomes.

Technical Characteristics of Curriculum-Based Measurement With Students Who Are Deaf.

This study compared the reliability and validity of student scores from paper-pencil and e-based assessments using the "maze" and "silent reading fluency" (SRF) tasks. Forty students who were deaf and hard of hearing and reading between the second and fifth grade reading levels and their teachers (n = 21) participated. For maze, alternate form reliability coefficients obtained from correct scores and correct scores adjusted for guessing ranged from r = .61 to .84 (ps < .01); criterion-related validity coefficients ranged from r = .33 to .67 (most ps < .01). For SRF, reliability coefficients obtained from correct scores ranged from r = .50 to .75 (ps < .01); validity ranged from r = .25 to .72. Differences between student performance on paper-pencil and e-based conditions were generally non-significant for maze; significant differences between conditions for SRF favored the paper-pencil condition. Findings suggest that maze holds promise, with inconclusive results for SRF.

Exploring the Relation Between Teacher Factors and Student Growth in Early Writing.

Data from a small randomized control trial of teachers' use of Data-Based Instruction (DBI) for early writing were analyzed to determine the influence of teacher knowledge, skills, and treatment fidelity on student Curriculum-Based Measurement (CBM) slope. Participants included 11 elementary grade teachers who delivered intensive intervention in early writing and their students (n = 31), all identified as either at risk for or with disabilities that affect their writing. Teachers received professional development and ongoing coaching to support the implementation of DBI for improving their students' early writing skills. Results from a multiple regression analysis suggest that teacher knowledge and skills in DBI was strongly related to student CBM slope in early writing (p < .01) and a small but significant relation between fidelity of writing instruction and student CBM slope (p < .01). Implications for instructional coaching and improving student writing progress are discussed.

The Inferential Language Comprehension (iLC) Framework: Supporting Children's Comprehension of Visual Narratives.

We present an integrated theoretical framework guiding the use of visual narratives in educational settings. We focus specifically on the use of static and dynamic visual narratives to teach and assess inference skills in young children and discuss evidence to support the efficacy of this approach. In doing so, first we review the basis of the integrated framework, which builds on major findings of cognitive, developmental, and language research highlighting that (a) inference skills can be developed in non-reading contexts using different media, (b) inference skills can transfer across different media, and (c) inference skills can be improved using questioning that includes scaffolding and specific feedback. Second, we review instructional and assessment approaches that align with the proposed framework; these approaches are designed to teach or assess inference making skills using visual narratives and interactive questioning. In this context, we discuss how these approaches leverage the unique affordances of static and dynamic visual narratives with respect to unit of meaning (by increasing opportunities to generate inferences), multimodality (by providing opportunities to generate inferences of higher complexity than text), and vocabulary/knowledge demands (by providing vocabulary/knowledge support), while also reviewing evidence for their usability, feasibility, and efficacy to improve educational outcomes. We conclude with important theoretical and practical questions about future work in this area.

Caregiver Training Via Telehealth on Behavioral Procedures: A Systematic Review.

Telehealth has been utilized to provide behavioral services to families with children with autism spectrum disorder (ASD) and other disabilities. This systematic review provides an update on current research pertaining to the use of telehealth to provide behavior analytic-based services and train caregivers in implementing behavioral procedures. This review also describes information on reported training components and caregivers' procedural fidelity. Empirical studies were collected from five databases. Overall, the studies provide evidence of the utility of telehealth as a service delivery model for providing behavior analytic-based services and for training caregivers to implement behavioral assessments and procedures. The authors discuss potential considerations for developing training packages and training caregivers via telehealth. Future research should use experimental methods to determine effective components for training individuals via telehealth to use behavioral procedures with good fidelity as well as to detect other factors that may influence procedural fidelity.

Commentary: Innovations, Insights, and Impact: Expanding Frontiers in Learning Disabilities Research.

In this commentary, I highlight key insights from research on learning disabilities (LD) reported in this special issue. Authors of each article describe innovative work that is expanding frontiers of LD knowledge, by focusing on vulnerable and understudied populations, using multiple methodologies and data sources, and building and refining theory. Insights that emerge from this work relate to defining and identifying LD; estimating prevalence rates of LD subgroups; and understanding the role of cognitive, language, genetic, and environmental factors and their implications for assessment and intervention. I conclude that findings of this work promise to have a significant and lasting impact on the lives of children and youth with LD.

Early Writing Intervention: A Best Evidence Synthesis.

The purpose of this best evidence synthesis was to identify promising interventions that align with a theoretical model of early writing development, targeting three components of early writing: transcription, text generation, and self-regulation. We determined the extent to which these interventions are effective for children who struggle with early writing skills, by calculating effect sizes for group and single-subject designs, and we examined the overall quality of the research. Twenty-five studies met inclusion criteria. Among group design studies, mean effects (Hedge's g) ranged from 0.19 to 1.17 for measures of writing quantity and from 0.17 to 0.85 for measures of writing quality. Percentage of all nonoverlapping data for single-subject designs ranged from 83% to 100% for measures of writing quantity. Interventions with the strongest evidence of effects and highest methodological quality are described in detail. Recommendations for research and practice are provided.

Technical features of curriculum-based measures for beginning writers.

The purpose of the two studies reported in this article was to examine technical features of curriculum-based measures for beginning writers. In Study 1, 50 first graders responded to word copying, sentence copying, and story prompts. In Study 2, 50 additional first graders responded to letter, picture-word, picture-theme, and photo prompts. In both studies, 3- to 5-minute prompts were administered in winter and spring and scored using a variety of quantitative procedures. Students were also administered the Test of Written Language-Third Edition , and teacher ratings and scores on a district rubric for writing were collected. Test-retest (Study 1 only) and alternate-form reliability, criterion validity, and winter-to-spring growth were examined for each measure. Sentence-copying, story, picture-word, and photo prompts emerged as promising beginning-writing measures. Findings have implications for monitoring student progress within a seamless and flexible system across ages and skill levels.